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I. INTRODUCTION 


A. GENERAL 

On October 26, 1982, the Deputy Under Secretary of the Army for 
Operations Research, in a memorandum to the Director of the Army Staff, 
identified the need for a target acquisition experiment. The data 
generated by such an experiment would provide beneficial information to 
the Army's analytical and training development activities. The test was 
to provide a comparison of the capabilities of weapon systems equipped 
with thermal sighting systems with those having optical sighting systems 
under a variety of conditions and factors. In response to this require- 
ment, Headquarters TRADOC appointed TRASANA as the proponent for a 
Thermal Pinpoint experiment. The United States Army Combat Developments 
Experimentation Center (CDEC) was subsequently appointed to conduct the 
field test and process the data generated by the experiment. The 
Thermal Pinpoint Test was a field experiment conducted to obtain data 
and information related to the problem of target acquisition by tanks 
and antitank weapons in overwatching and attacking roles. Controlled 
factors such as time of day, range, sight type, observer motion and 
target cues, as well as environmental factors such as temperature and 
sky/background visual contrast were incorporated into the test so that 
their effects on the target acquisition process could be investigated. 

In the test, target acquisition for each observer crew was examined 


in terms of the following dependent variables: 
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1. The number of initial detections by each crew during a trial. 


2. The number of correct recognitions (corresponding to initial 
detections). 


3. The time required to detect targets (time interval from the trial 
start time or a begin search event until the detection of a 
target). 


4. The time required to recognize (time interval from detection until 
recognition). 


5. The time required to engage targets (time interval from 
recognition Unt lier trims = 


6. Gunner lay error (the horizontal and vertical miss distances from 
the target aim point). 
bee “EOF “DEGucn 
The test was specifically designed to evaluate the effects of the 
following independent variables on the target acquisition processes: 
1. Time of Day (morning/day/evening/night). 


a) morning: one hour before sunrise until one hour after 
Sunrise. 


b) day: one hour after sunrise until two hours before sunset. 
c) evening: two hours before sunset until one hour after sunset. 
d) night: one hour after sunset until one hour before sunrise. 
2. Observer Sight Type (thermal/optical). 
3. Observer Motion (overwatch/attack). 
4. Observer Hatch Status (tanks only) (open/closed). 
5. Nominal Range to the target (long/medium/short). 
a) long: 2750 - 3250 meters. 
Db) medium: s750s2250 meters. 


ec) short: 750-1250 meters. 


6. Target Cues: 


a) 
b) 
3), 
d) 
e) 


i) 


engine status (off/running/NA) ; 

crew exposure (exposed/not exposed/NA); 
motion / Sluete ROTEF AW ACTS UAT) 
camouflage (none/partial/full/NA) ; 
firing (with/without) ; 


other (glint, noise, dust, smoke). 


7. Environmental Covariables: 


a) 
b) 
e}) 
d) 
e) 
f ) 
g) 
h) 
i) 
j) 
k) 


Ly, 


target/background temperature contrast; 
target/background visual contrast; 
light level (night trials only); 
sky/background visual contrast; 
Ves Dela ys 

windspeed and direction; 

air temperature; 

umn vy > 

cloud cover; 

cloud height; 

soil peTenat une: 


dewpoint. 


The test design plan [Ref. 1] provides a detailed discussion of the test 


objectives and the experimental deSign. NA status above applies to 


hnulks and decoys, discussed below. 


€. CONCERT OF 3h. ii ear 

In order to provide an adequate analysis, one must have a clear 
understanding of how the Thermal Pinpoint data were collected and 
subsequently reduced. The collection process is described below in the 
section entitled 'Data', and in the Test Design Plan [Ref. 1]. The 
following is a short description of a trial and the events that took 
place during a trial. 

A trial consists of four tanks and two Tube Fired Optically Tracked 
Wire Guided (TOW) antitank weapons servicing a target array of ten 
targets (usually 4-tanks, 2-Armored Personnel Carriers, 2-decoys and 2- 
tank hulks). The observer force may be categorized as follows: 

1. Tank, thermal sight, hatch closed. 

2. Tank, thermal sight, hatch open. 

3. lank, optical ‘signt, natch: closed: 

4, Tank, optical signt, hatch open. 

5. TOW, thermal sight. 

6. TOW, Ootical Sight. 
This thesis will not address the TOW weapon system. The remainder of 
the thesis concerns tanks only. 

In addition, a trial may be categorized aS either movingeeg 
Stationary. For moving trials, the observer tanks were in an attack 
role. Trial duration was a maximum of four minutes. FOr @Stav tome. 
trials, the observer tanks were in an overwatch role. Trial duration 
was ten minutes. During a trial, specific event data corresponding to a 
valid or nonvalid engagement are generated by the various observers. A 


valid engagement may be considered as the initial detection and 
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acquisition of any one of the ten targets in the target array. A 
nonvalid engagement is detection and acquisition of ‘targets’ other than 
those in target array, such as false targets and hot spots, or 
subsequent re-detection of a valid target. The following events may 
eccur’s 

1. Tank crew detects a target; 


2. Member of crew detecting the target is identified (commander or 
gunner); 


3. Type of detection cue is identified (possibly unknown) ; 
4. Tank crew recognizes the target type; 


5. Member of crew recognizing the target is identified (commander or 
gunner ); 


6. Claimed target type is recorded; 
7. Tank gunner fires at target; 


8. Tank crew begins search for next target (new start search time 
recorded) ; 


9. Tank gunner changes field of view of sight (narrow or wide field 
of view); 


10. Tank gunner changes contrast (polarity) of thermal sights (white 
hot or black hot); 


11. Tank commander changes method of search (binoculars, vision 
blocks, etc.); 


12. Tank tube azimuth recorded during the search interval for the next 
target. 


Each event begins with a start search time and may or may not culminate 
in the detection and acquisition of a valid target. 
D. LIMITATIONS OF THE EXPERIMENT 

The Thermal Pinpoint test was a strictly controlled field test 


limited in tactical realism and hence, care must be exercised in the 


lis 


interpretation and extrapolation of the results. It must be remembered 
that the results apply only to crews working as individuals without 
communications between vehicles. The test was conducted this way to 
obtain data on the performance of individual crews. However, care must 
be exercised in applying these results to teams of weapon systems. Such 
applications may result in different findings from those obtained in 
this study in terms of their tactical implications. It should be noted 
that the experiment was performed in a temperate climate and the 
experimental results may or may not apply to operations in very hot or 
very cold climates, with different terrain, clutter, atmospneam 


eOndltilons,; eee. 


Ey. SCOPE OF THE THESIS 

This thesis applies to analysis of the Thermal Pinpoint database. 
It concerns only data generated by observers in tanks without nuclear 
and biological protective equipment. The dependent variables considered 
are number of detections (in the form of proportions) and times to 


detection. 


gee ae 


A. GENERAL 

The data used in this analysis were collected during the period 19 
July to 10 December 1983 at Fort Hunter Ligget, California. The data 
were accumulated and reduced by the United States Army Combat 
Developments Experimentation Center, Fort Ord, California. Data from 
the test came from the following five sources: 

1. The Range Measuring System (RMS). 

2. Tube mounted closed circuit television. 

B Field forms and manually recorded information. 

4, Environmental monitoring and measuring equipment. 

5. Player questionaires and interviews. 
ime RMS [Ref. 1:pp. £36-38] is used i generate the two dimensional 
position of each player at the time of each event entry. It is a 
combination of position location and telemetry systems. 

The analysis provided in this thesis will concern the independent 
Variables described in the 'Test Design' Sea aiten Of sGmis Lhesis. 
However, the only environmental covariables studied are Bry jacienound 
Wmoudl Contrast, target/background temperature contrast and 
target/background visual contrast. In addition, the various trial sites 


used during the test are be studied. 


fee DESCRIPTION OF DATABASE 
The Thermal Pinpoint database is composed of trial and engagement 
event data generated from 288 separate trials. The experimental design 
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[Ref. i:pp. 3-9] provides for all combinations Of st memonman ae ere 
design variables (time of day, range, observer motion, hatch status, 
sight type) with varying numbers of replications. Twenty of the trials 
were classified and another 36 were with nuclear and biological 
protective equipment. These trials are not used in the present analysis 
and hence, the analysis utilizes the event and trial data generated in 
the remaining 232 trials. Each trial provides data from four separate 
observer combinations, of the primary design variables, for analysis. 
During a trial, each observer generated a variable number of engagement 
events for valid and nonvalid targets. During an engagement event, the 
data for 15 variables of interest were collected and ceeds 
additional 27 variable quantities were recorded for each trial. The 
test variables [Ref. 1:pp. 3-(4)-3-(5)] are manifestations of the 


physical environment, test design and observer actions. 


C. PRELIMINARY DATA PREPARATION 

The Thermal Pinpoint test design [Ref. 1] was not balanced. For 
example, there are twice as many replications for day and night cra 
than for evening and morning trials. For a priori reasons, and possiaay 
EO provide balance to the design, it is of interest to Know whether 
evening and morning trials can be combined. A Friedman Test [Ref. 2:pp. 
299-305], for all observer combinations of motion, hatch status, sight 
type and range as the blocks, was performed with the mean times to 
detection for evening and morning trials, within the Si0CcKsS  =asaei. 
criterion of interest. Evening and morning trials are the treatments. 
In this way, the results apply across all observer groups. 


following null hypothesis was tested: 


18 


Hy? Each ranking of the mean times to detection for morning and evening 
trials, within a block is equally likely (i.e. the two treatments have 


identical effects). 
The alternative hypothesis may be written as follows: 


Hy: One of the treatments tends to yield larger observed values than 


the other treatment. 


The null hypothesis is rejected if the Friedman Test statistic 
exceeds the 0.95 quantile of the F-distribution with 1 and © (number of 
blocks/observations) degrees of freedom. The test statistic obtained is 
2.60. The 0.95 quantile of the F-distribution is 3.84. Therefore, the 
null hypothesis is not rejected. In fact, the probability of getting a 
greater F value is 0.11. It was decided that evening and morning trials 


would be combined in the remainder of the analysis. 


ls 


A. 


ITI. ANALYSTS OF TARCED SACO) 


DEFINITIONS 


Before proceeding with the analysis, it is helpful to define some of 


the terminology that follows. 


lie 


oe 


Factor--~an independent variable to be analyzed in ANOVA or 
Functional Category Models (e.g. time of day). 


Factor level--a particular form of a factor (such as dayne 
evening for the factor time of day). 


Treatment--in ANOVA models, this term refers to a specific 
combination of the factors being studied. In the Friedman Test, 
it describes the factor levels of a factor of interest. 


Main effect--the effect on mean response associated with levels of 
a particular factor. ) 


Interaction--occurs when the level of a second factor affects the 
relative scores (e.g. mean times to detection) across different 
levels of a first factor. Here, relative means the difference 
between the scores. 


Population--the universe of all observations from which the sample 
is taken. - 


Contrasts--a linear combination of the population means Such thaw 
the sum of the coefficient is zero. 


ANALYSIS TECHNIQUE 


The statistical procedures employed in this study were implemented 


with subprograms included in the Statistical Analysis System (SAS) (Ref. 


3 and 4] and an APL System for Interactive Scientific/Engineering 


Graphics and Data Analysis (GRAFSTAT). The subprograms used were 


General Linear Models (GLM), Functional Category Models (FUNCAT), MEANS, 


Summary, Frequencies (FREQ), UNIVARIATE and MATRIX from the SAS library 


and the GRAFSTAT program for various plotting funevionse 
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The subprogram GLM was used for the ANOVA models that follow. GLM 
uses the method of least squares to fit a general linear model. It is 
appropriate for analyses with unbalanced designs. It provides for four 
mypes Of estimable functions of parameters for testing hypotheses. 
Since the Thermal Pinpoint design is unbalanced, "Type III" tests were 
utilized [Ref. 4:pp. 229-241]. 

The FUNCAT procedure computes a log-linear model of categorical 
responses. A response is categorical if the measured quantities are 
frequency counts. These counts are assumed to follow a multinomial 
distribution. Each treatment has a different multinomial distribution 
for the response counts. The procedure produces minimum chi-square 
estimates for parameters in a standard response function. The response 
function is called a logit function, since it models the logs of ratios 
Sreemulcinomial probabilities. 

The subprograms MEANS, Summary, FREQ and UNIVARIATE were used to 
Meecverae GescripLtive statistics and to display the distributional 
characteristics of various treatments, such aS means, variances, 
quantiles, sums and numbers of values. 

The subprogram MATRIX is both a SAS procedure and a programming 
language. It was used in this analysis to provide general purpose 


programming of procedures or programs unavailable in SAS. 


@e SCATTER PLOTS 
As a preliminary step in the analysis, the dependent variable 


detection time was plotted versus sky/background visual contrast, 


target/background visual contrast and target/background temperature 
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contrast for all combinations of the primary design variables. If there 
appeared to be strong relationships between these variables, then the 
corresponding independent variables would be used as covariates in 
analysis of covariance to help reduce the experimental errors and make 
the analysis more powerful. Figure 1 shows typical examples of these 
plots. The displayed examples are for day, overwatch, optical sight, 
open hatch and short range trials. In these plots, a robust Sieger 
curve is added. It can be seen that there is not a strong relationship 
among these variables and time to detection. 

Mean times to detection and mean proportion of detections for each 
treatment are statistically correlated; Spearman's Rho [Ref. 2:p. 254] 
for these variables is 0.385, leading to rejection of a hypothesis of 
independence. The positive correlation suggests a tendency for larger 
values of mean times to detection and mean proportions of targets 
detected to be paired together. AS a result of this correlation, it is 
plausible that conclusions that apply to detection time, as above, ema 


also apply to proportions. 


D. ANALYSIS OF TARGET COVARIABLES 

Friedman Tests were performed to determine if significant 
differences in the mean times to detection occurred among the various 
observer types. An observer type is described by combinations of the 
primary design variables (such as day, overwatch, optical sight, hatch 
closed, short range). The comparisons of interest concern the trial 
Sites and target cues and their possible significance in the target 


acquisition process. The results of tests for target cues and trial 
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sites are summarized in Table 1. The results indicate thatealiecace—« 
cues, except firing, and trial sites are significant at the 0.05 level. 
TABLE 1 


SUMMARIZED RESULTS OF FRIEDMAN TESTS PORT AnGE aeucs 


Criterion: Mean Times to Detection 


Target Cue/ Test 0.95 Quantile Significance 
Trial Site otatistic DF F=Distripucioen Level 
Motion Dee5 (24°) B00 0.00% 
Firing ee (1.2) 3.84 Om2y 
eee 9.26 (2,) Boe 0.00* 
Crew Exposure 8.42 (2,°) 2.00 0.00* 
Camouf lage aa (3,2) ley ©) 0.00* 
Vehicle Type 6.00 (35°) 2.60 0.00% 
Trial ed be 43.64 i) 200 0.00* 


* Indicates significance at the 0.05 level. 


This suggests that the treatments may motynave identical effects foOreGa 
VECTOUSMVCDSeryer soonDina lions. The treatments for each target 
covariable were contrasted to determine which are significantly 
different. The results are summarized in Table 2. For all target cues, 
the differences are associated with hulks and decoys. Treatments that 
were applicable during a trial, such as engines on versus engines off, 
are not signifiantly different. Trial sites, in general, disp 


Significant differences. Trial site 18 incorporated as a factor in vine 
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TABLE 2 


TREATMENT COMPARISONS: FOR FRIEDMAN TESTS 
RESULTING IN REJECTION OF THE NULL HYPOTHESIS 


Criterion: Mean Times to Detection 


Trialgsite 
Pairwise Difference Sample Sizes 
Ovs. 1 Coes) 
Ovs. 2 (44, 415) 
Ovs. 3 (44, 29) 
Ovs. 4 Ce ee 
O vs. 6 (U4, 202) 
Ove. 6 (44, 1524) 
Ovs. 9 (44, 886) 
1 vs. 2 C3 lees 15) 
Rats as (3111, 29) 
1 vs. 4 Cai. tu22) 
1 vs. 6 Call, 2o2) 
I iste. (3111, 1524) 
1 vs. 9 (Si lieeoeo) 
EN S| (4155, 29>) 
2vs. 4 (415, 1422) 
2 oer O (415, 202) 
2aNG ae CAS aloes) 
2vs. 9 CM ST sale) 
3 vs. 4 (29 1422) 
3 vs. 6 (290 ce) 
3 vs. 8 (29, 1524) 
3 vs. 9 (29, 886) 
4 vs. 6 (1422, 202) 
iV Seno (1422, 1524) 
4ovs. 9 (1422, 886) 
6 vs. 8 (202, 1524) 
6 vs. 9 (20292600) 
8 vs. 9 CiS24 oc) 
Crew Exposure 
Pairwise Difference Sample Sizes 
Not Exposed vs. Exposed (2861, 487) 
Not Exposed vs. NA (2861, 1967) 
Exposed vs. NA (487, 1967) — 


Conclusion 


Seema Lean 
Sienitveant 
SPenit leant 
Slenli lcant 
Sienien Lean 
Seni? Lcant 
Semen. Caliiu 
Not Significant 
Not Ssienipicant 
SLene! veanit 
Not Ssienificant 
Significant 
Slenit icant 
Slenificant 
Silent cant 
Not Significant 
NO Uwolerih 1eant 
Not Significant 
Silene lcant 
Noteolenit 1ecant 
Sienif icant 
Significant 
significant 
sLenifieant 
Significant 
Seni ficant 
Not Significant 
Not Significant 


Conclusion 


Not Significant 
Sleniticant 
SL eae cant 


TABLE 2 (continued) 
Target Camouflage 


Pairwise Difference Sample Sizes 


None vs. Full (2956, 162) 
None vs. Partial (2956, 230) 
None vs. NA (2956, 1967) 
Partial vs. Full (230, 162) 
Partial vs. NA (230, 1967) 
Full vs. NA (162, 1967) 


Target. Firing 
Pairwise Difference Sample Sizes 


No vs. Yes (4791, 460) 


Target Motion 


Pairwise Difference Sample Sizes 


Stationary vs. Moving (2055, 804) 
Stationary vs. NA (2055, 1967) 
Moving vs. NA (804, 1967) 


Vehicle Type 


Pairwise Difference Sample Sizes 


Tank vs. APC (2200, 1044) 
Tank vs. Hulk (2200 6 34) 

Tank vs. Decoy (2200 woSe) 

APC vs. Hulk (1044, 634) 

APC vs. Decoy (1044, 582) 

Hulk vs. Decoy (634 562) 


Target Engines 


Pairwise Difference Sample Sizes 


Off vs. On (2055, 1293), 
Off vs. NA (2055 7am 0 7) 
On vs. NA (1293567) 


Conelusion 


Not Sienificant 
Not Significant 
SLEnUE Peay 

Not Significant 
Not -Sienif teane 
Not Signi tf veame 


Conelusion 


Not Significant 


Conelusion 


Not Significant 
Signi freany 
Signif leant 


Conclusion 


Not Significant 
Significant 
NOt Signumreane 
Signi ficankey 
Not Signs veank 
Not Signit reang 


Cone lus ron 


Not Significant 
Signit teane 
Significant 


Where NA above refers to status for hulks and decoys. 
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ANOVA models that follow. The ae site significance is in agreement 
with published reports by G. E. Corrick [Ref. 3] and Lynn A. Olzak [Ref. 
4] who conducted experiments to determine the effects of target 
Dbaekeround on target acquisition for aerial observers. Their results 
show that the physical environment of targets is significant in the 
target acquisition process for aerial observers. The author believes 


that this issue should be pursued further for ground observers. 


E. ANOVA FOR PRIMARY DESIGN VARIABLES AND TRIAL SITE 
ho | JaUULD Jukefercnl 

The ANOVA procedure is performed to determine which variables 
(factors) have noteworthy effects on the times to detection and 
proportion of targets detected. The procedure also provides 
quantitative information about the relative importance of different 
factors and their levels. 

The linear model for the primary design variables associated 
with a factorial design, may be written as follows: 


y Worte-a. + B + Ye + T) + Van + § 
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- 
— 
WD 
ey 
<= 
~~ 
G3. 
a 
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ai 


‘ Se a + (BYTW) sean 
* COBYTY)s seam * ©i4x1mno 

Aner e. 

i aaliniots = true value of the dependent variable of interest at various 
levels of the design factors (o indicates the replication 
number). 

uy = fixed, but unknown, population mean; 

a = observer motion main effects; 

B = time of day main effects; 

ay, = type of sight main effects; 

toe hatch status main effects; 

ie = range main effects; 


(>) = interaction effects; 
Ei 4yK1mno = random experimental error. 
PE aks assumed that the experimental errors are distributed 
N(o,o7) and are independent and identically distributed. The 
experimental error variance is estimated over a wide range of test 
conditions and there is an adequate sample size (degrees of freedom) 
avallable for its estimation. 
2. Effects of Departures from Model 

Major departures from the model assumptions may be found oy 
examining various plots of the residuals. -Normality of dhe error terns 
is studied by plotting the residuals in the form of a frequcies 


distribution to see whether this distribution differs markedly from a 
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lormaredistribution. The cumulative distribution function of the 
residuals is plotted versus a theortical Normal cumulative distribution 
function to see whether the points fall on the theoretical curve. Ina 
Similar fashion the residual cumulative distribution function may be 
plotted on Normal probability paper to see whether or not the points 
fall approximately on a straight line. Chi-square goodness of fit tests 
may also be employed. The homogeneity of variances assumption is 
studied by plotting the standard deviations, (s), versus the mean times 
to detection or mean proportion of targets detected, (x), for each 
treatment to determine the nature of the relationship between them. 

Figure 2 shows plots of the residuals for times to detection, in 
the form of a frequency distribution, a cumulative distribution function 
and a Normal probability plot. The plots show that the residuals are 
moc Normally distributed. Pmemeir=square goodness-of-fit test 
Significance level is 0.00. The x-s plot is shown in the left panel of 
Figure 3 for times to detection. As the treatment mean times to 
detection increases, the standard deviation also increases in a linear 
fashion. Figure 4 shows the same plots as Figure 2 for proportion of 
targets detected. The plots show that the residuals are appoximately 
Normal. The Chi-squared goodness of fit test significance level is 
O.11. The x-s plot for proportion of targets detected is shown in the 
right panel of Figure 3. The plotted points display a curvilinear 
pattern which indicates a possible quadratic relationship. 

In both plots of the treatment Standard deviations versus the 
jeans, Figure 3, the points form two distinet groups. One group is 


associated with Overwatch/Stationary trials and the other with Moving 
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trials. This implies that the two types of trials are quite different. 
One would anticipate this, since moving trials lasted a maximum of four 
minutes and overwatch trials were ten minutes in duration. The 
Gesparity in trial duration; as well as the marine oF the trials, 
attacking versus defending, could very easily account for the observed 
grouping. 
3. Transformation of Variables 

The results of the analysis performed on the residuals for both 
dependent variables indicate that the model asSumptions are not 
satisfied. In particular, the standard deviation versus means plots 
indicate that the assumption of homogeneity of variances is false. An 
appropriate corrective measure is to use a transformation on the data to 
stabilize the variances. POGmumece times, tom@elFection, a clog 
transformation was chosen since the plot in Figure 3 appears linear 
[Ref. 7:p. 507]. For the proportions, an appropriate transformation is 
the are sine [{Ref. 7:p. 507], since we are concerned with the percent of 
valid targets identified. The transformation may be written as follows: 


for times to detection; 
Y" = log(Y+1); 


for proportions of targets detected; 


Y' = aresinVY/N+1 + arcsinVY+1/N+1, 


mmere tl refers to the number of cases on which the proportion is based. 
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The residual and x-s plots for transformed data are shown in 
Figures 5 and 7, respectively, for times to detection. The residual 
plots show a closer approximation to a theoretical Normal distribution. 
The Chi-square goodness-of-fit steniricenee level is 0.04. In the x-s 
plot, the linear relationship between the means and standard deviations 
is no longer present. However, the groupings by observer motion are 
still present. In general, within these groups, as one looks from left: 
to right, the points form a band with constant vertical scatter. The 
residual and x-s plots for transformed data are shown in Figures 6 and 
7, respectively, for proportion of targets detected. In the residual 
plots, the frequency distribution is still quite bell-shaped. The Chi- 
square goodness of fit significance level is 0.00. The X-s plots do n@e 
display the curvilinear relationship shown in Figure 3. The comment 
concerning groupings above also applies to the proportions. The x-s 
plots for both dependent variables display isolated points that are 
remote from the rest of the plotted values. Since the author is unsure 
of why this occurred, the values that were used to compute these means 
Will not be disearded. 

For a fixed effects model, such as this one, lack of Normality 
is not an important matter, provided the departure from Normality 1s not 
of extreme form [Ref. 7:p. 513]. The point estimators of factor level 
means and contrasts are unbiased whether or not the populations are 
Normal. The F test for the equality of factor level means is affected 
wer yy Lyttle By departures from Normality which are not of extreme form; 
in terms of the level of significance. If the residual variances are 


unequal, the F test for equality of the means with the fixed effects 
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model is only slightly affected when the design is balanced. However, 
Since this design is unbalanced, comparisons between factor level means 
may be substantially affected by unequal variances. The author feels 
that the transformations have, in general, brought about approximate 
equality of variances for both dependent variables within the groupings 
described for the levels of the factor observer motion. 
4, ANOVA Results for Transformed Variables 

Summarized results of the ANOVA's are shown in Table 3 for times 
to detection and proportions of targets detected. For proportions, time 
of day interacts with all other factors except hatch status. There is 
also a significant three-factor interaction between observer motion, 
Sight type and range. For times to detection, sc:1me of day interacts 
strongly with observer motion and Sight type. There is asim 
Significant two-factor interaction between hatch status and range. A 
three-factor interaction between time of day, sight type and range is 
also significant. The presence of significant interactions implies that 
one cannot make generalizations about the effects of each factor 
separately in terms of the factor level mean time to detection or mean 
proportion of detections. For both dependent variables, the factor time 
of day interacts strongly with other factors. Recall the X-S plots fem 
times to detection and proportions of targets detected displayed 
groupings by observer motion. Thus, it seems prudent to perform 
separate ANOVA's for each combination of observer motion and time of 


day. The results are shown in the next section. 


- 
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TABLE 3 


ANALYSIS OF VARIANCE SUMMARIES: TEST STATISTICS 
AND SIGNIFICANCE LEVELS FOR DETECTION TIME 
AND PROPORTION OF DETECTIONS (TRANSFORMED VARIABLES) 


* Denotes significance at the 0.05 level. 


Oe 


source DEF Proportions Detection 

TOD (Time of Day) 2 31.15(0.0001)* CV AOUACe) - eleyoy | is 
OM (Observer Motion) 1 55 ls Oo00. 0001 )* Seen @oo 1) 
TOS (Sight Type) 1 63.23(0.0001)* 3.05(0.0809) 
for (Hatch Status) 1 0.05(0.8282) 8.20(0.0042)* 
RANGE 2 20.48(0.0001)* 226 (0.1041) 
TRSITE (Trial Site) T 5.68(0.0001)* 7 25 tenoO0 | )* 
TODxOM 2 9.34(0.0001)* 3.48(0.0309)* 
TODxTOS 2 59.24(0.0001)* 2G 1510. 0001) * 
TODxHS 2 2.22 OeOST 1. 50COm2068 ) 
TODxRANGE 4 2.40(0.0483) 0.09(0.9844) 
OMxTOS 1 ecneOeesie OL Tice e022) 
OMxHS 1 Onl 260n 2g) 1.24(0.2656) 
OMxRANGE 2 lI Zo Oe ae 52) 0.88(0.4167) 
TOS xHS 1 0.00(0.9702) a5 (O52 109) 
TOS xRANGE 2 0.27(0 0685 ) 1. 1540. 3180) 
HSxRANGE 2 Cer ON) 4.90(0.0075)* 
TODxOMxTOS 2 0.05(0.9545) 0.52(0.5958) 
TODxOMxHS 2 GzooCOec400) 1 2S 010 =O 56 ) 
TODxOMxRANGE 4 1.65(0.1595) 1.01(0. 3994) 
TODxTOSxHS 2 25 eee 15) HOO One 4) 
TODxTOS xRANGE 4 1.39(0.2367) 0.31(0.8746) 
TODxHS xRANGE 4 0.98(0.4201) 20 | (OsugGs) 
OMxTOSxHS 1 0.00(0.9805) 1 aee VG) 
OMxTOSxRANGE 2 3.69(0.0254)* O.760(0. 4586) 
OMxHSxRANGE 2 0.55(0.5751) 0.42(0.6566) 
TOS xHS xRANGE 2 0.59(0.5525) 0.59(0.5550) 
TODxOMxTOSxHS 2 0.08(0.9226) 22390-09014) 
TODxOMxTOS xRANGE y 1.69(0.1505) eco COeneiie) 
TODxOMxHSxRANGE 4 2.23(0.0644) 1.73(0.1401) 
TODxTOS xHSxRANGE 4 0.76(0.5495) 129406. 1010) 
OMxTOS xHS xRANGE 2 ieseto se62e > 2 apr ias 29) 
TODxOMxTOS xHS xRANGE 4 6420040266} Geno On55 16) 
MSE 9 0.009 0.228 


5. Results of ANOVA Models for Time of Day and Observer Motion 
Combinations 


The factors range, Sight type, hatch status and trial site are 
analyzed for each time of day and observer motion combination. ANOVA 
summaries are shown in Tables 4 and 5 for times to detect iommemag 
proportions of targets detected, respectively. For times to detectiem: 
the sight type is significant for all combinations of observer motion 
and time of day, except Evening/Morning trials. Trial Sia 
Significant for all combinations. For proportion of targets detected, 
the sight type is significant in all cases except Day Overwatcnh trials. 
Range is significant in all cases except Evening/Morning Overwatch 
trials. These two cases would be significant at the 0.1 level of 
Significance. However, there are also significant two-way interactions 
in both cases. For detection time, the sight type and hatcn status 
interaction for Day Overwatch and Night Moving trials are significant, 
as well as sight type and range for Evening/Morning Overwatch trials and 
hateh status and range for Night Overwatch trials. For the proportions, 
the only significant two-way interaction is sight type and range for 
Night Overwatch trials. The only Significant three-way interaction is 


for times to detection in Day Overwatch trials. 


F. COMPARISONS OF MEANS 
If there are no significant interactions, comparisons of the factor 


level mean times to detection or proportion of targets detected are 
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(DO) 
(DM) 
(EQ) 
(EM) 
(NO) 
(NM) 


(DO) 
(DM) 
(EO) 
(EM) 
(NO) 
(NM) 


(DO) 
(DM) 
(EO) 
(EM) 
(NO) 
(NM) 


ANALYSIS OF VARIANCE SUMMARIES: 
STATISTICS AND SIGNIFICANCE LEVELS FOR TIME 
OF DAY AND OBSERVER MOTION: 


TABLE 4 





TOS HS 
Memeo, O00 Iran 5 27 (01.0218) * 
(emieno O0S0) * 0, 0600.6134) 
@4200',517 3) 1.30(0.2536) 
mee). 1209) ee 0. 3740.5417) 
52.19(0.0001)* 1.10(0.2949) 
- 4,45(0.0358)* 6.43(0.0117)* 
TOS xRANGE HS xRANGE 
1.66(0.1910) 1.27(0.2824) 
0.52(0.5949) 0.46(0.6298) 
5.24(0.0054)* 2.41(0.0901) 
2.82(0.0609) 1.20(0. 3025) 
Ge fice 37 33) 3.68(0.0256)* 
OuneOe solo) 2.73(0.0667) 

MSE _DF 
O2253 1423 
Ors Y 377 
0.244 ee 
One 364 
0.245 761 
0.167 298 


—- O 0 -W — 


mM —- ONMO OD 


Eon 


TIMES TO DETECTION 


om Cor 
-56(.5674) 
5 ISG 
sele(O- 
Bio. oe 
“EMU. 


we3 00. 
518) (le 
.08(0. 
eee: 
Cee 
30 (0. 


* Indicates significance at the 0.05 level. 


Where, 


DO 
DM 
EO 
yl 
NO 
NM 
MSE 


Day Overwatch. 

Day Moving. 
Evening/Morning Overwatch. 
Evening/Morning Moving. 
Night Overwatch. 

Night Moving. 

Mean Square Error 


4} 


RANGE 


1609) 


3180) 
4261) 
4576) 
2076) 


TOS xHS xRANGE 


0020) * 
6813) 
252) 
8193) 
2436) 
0947) 


OVO SO 


“JN EPWW ££ oO 


TOS xHS 


O40. 
58 (oe 
esi O 
»30(0. 
Peo 0. 
-69(0. 


O249)* 
4422) 
B85 5:) 
5833) 
6123) 
Onie2)) = 


TRSene 


41 CC 
eIGer 
5 (ONeNe il 
4910. 
~34(0. 
Sole (Ube 


0001)* 
0092)* 
0065) * 
0316)* 
0007 )* 
0005)* 


ANALYSIS OF VARIANCE SUMMARIES: 


TABLE 5 


TEST 


STATISTICS AND SIGNIFICANCE LEVELS FOR TIME OF DAY 


AND OBSERVER MOTION: 


PROPORTION OF TARGETS DETECTED 





TOS HS RANGE TOSxHS 

(DO) ala uOeO7 70) 3,15 00507 60) 3.1700.0446)* 0.37(0.5449) 
(DM) 8.18(0.0048)* 0.09(0.7608) 3.37(0.0366)* 1.10(0.2951) 
(EQ) 9,06 (0. 00 30 ) = rer J ence 40) 2.75(050668) 0.3700 .544% 
(EM) 5.49(0.0205)* 0.60(0.4406) 12.69(0.0001)* 0.19(0.6668) 
(NO) 72;,01(0. 0001) <a OC Commis oe) 3.33(0.0382)* 123500 .207a9 
(NM) 107.0200. 0001) 9) 1 0see3050) 12.64(0:0001)* 2.97 (0 s0saam 

TOS xRANGE HS xRANGE TOSxHS xRANGE TRSITE 
(DO) Pe aCe a 4/445) ) 1.44(0.2406) 1. TOO = ere) 1.38(0. 20 oe 
(DM) O27 30s 4841) Ones (O e272) 0.38(0.6852) 3.64(0.0283)* 
(EO) 0.01(0.9924) 0.43(0.6539) O.7 3046 168 2.10(0.0140te 
(EM) 3.00(0.0529) PLEISK8)i(0) 6s) 0.39(0.6745) 2.08(0.12900 
(NO) WOO Cor oOee |) 0.50(0.6067) 0.09(0.9124) 7.42(0.0001)= 
(NM) 1202002 3682) 2.19(0.1152) 1.08(0. 3439) 0.62(0.5 4005 

MSE DF 
(DO) 0.007 175 
(DM) 0.008 168 
(EO) C7014 165 
(EM) 0.008 14y 
(NO) 0.011 160 
(NM) 0.006 148 


* Indicates significance at 0.05 level. 


Where 

DO = Day Overwatch. 

DM = Day Moving. 

EO = Evening/Morning Overwatch. 

EM = Evening7 Morning Moving. 

NO = Night Overwatch. 

NM = Night Moving. : 
MSE = Mean Square Error 


analyzed. For two factor or three factor interactions, comparisons of 
the means for all combinations of the interacting factors are analyzed. 
The 95% confidence intervals are presented for the contrasts between 
means, based on the untransformed data. In addition, the mean times to 
detection and mean proportions of targets detected for the interacting 
factors were viewed graphically as an aid to understanding the nature 
and significance of the interactions. The means are compared using a 
method developed by Tukey and Kramer [Ref. 5:pp. 473-477]. The use of 
this method insures that the confidence coefficient, 0.95, applies to 
the entire set of estimates and not to single estimates of the contrasts 
of interest. 

Tne comparisons that follow will be displayed in terms of the 
untransformed dependent variables. In Some cases, the untransformed 
variables do not display significant differences detected with 
transformed variables. To some extent this is expected, since the 
transformation was applied to stabilize the variability in the model and 
the power of the tests with the transformed data can be expected to be 
higher than those without transformed data. With untransformed data, 
the mean square error, an estimate of the error variance, is large and 
Gne would expect tne derived Tukey~Kramer confidence intervals to be 
large. In these cases, the differences in the means of the dependent 
variables of interest will be highlighted in terms of the transformed 
Variables. 


1. Plots of Mean Times to Detection and Mean peo Re ELOn of Targets 
Detected for Interacting Factors 


Figures 8 and 9 depict, graphically, the mean times to detection 
and mean proportion of targets detected. Figure 8 depicts the mean 
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times to detection for Sten type and hatch status in Day Overwatecnh 
trials. Since there is also a three-way interaction with range, the 
sight type and hatch status curves for each range are plotted. The 
curves indicate that the mean times to detection for optical sights are 
Similar for each range. The opposite is true for thermal sights. For 
short range, the open hatch curve is above the closed, while for medium 
range, the opposite is true. The mean times to detection for sight type 
and hatch status in Night Moving trials are shown in Figure 9. The 
curves are similar to those in Day Overwatch, except it is the thermal 
sight which displays similarity in the mean times to detection. These 
are pleasing results in that they follow what one would intuitively 
expect. In the daytime, optical observers perform similarly, regardless 
of hatch status. The same is true for thermal sights at night. The 
mean times to detection for sight type and range in Evening/Morning 
Overwatch trials are shown in Figure 9. Though one can see the presence 
of strong interactions, in the form of nonparallel and crossing curves, 
note that the mean times to detection for thermal sights are about equal 
or better than Spe leNL sights in all cases. The mean times to detection 
for hatch status and range in Night Overwatch trials are shown in Figure 
9. The interactions here are quite obvious. What is interesting about 
this @raph is the fact that it does not follow What one jwoumee 
intuitively expect. One would expect that the times to detection for 
open hatch would, in general, be smaller than closed hatcn. In this 
particular case, we run the gambit of possibilities. ‘For short range, 
intuition holds, however for medium range, the opposite is true. For 


long range, the mean times to detection for open and closed naten Tsim 
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same. The mean proportion of targets detected for sight type and range 
in Night Overwatch trials are shown in Figure 9. The short and medium 
range curves are almost parallel (indicating no interaction). The 
thermal sight performs better than the optical sight in all cases. 

2. Analysis of Factor Level Means 

Recall in Tables 4 and 5, one can see that there are factors, 
ier combinations of observer motion and time of day, which do not 
muperacty Significantly with other factors. For times to detection, 
trial site is significant over all combinations of observer motion and 
time of day. Significance is also seen for sight type in Day Moving and 
Night Overwatch trials. For proportion of targets detected, sight type 
is significant over all combinations of observer motion and time of day 
except Day Overwatch trials. Range is significant in all cases except 
Evening/Morning Overwateh trials. Trial site is significant in Day 
Moving, Evening/Morning Overwatch and Night Overwatch trials. 

Table 6 displays the comparisons of the factor level mean times 
MemaeLeCCLion for trial sites over all combinations of observer motion 
and time of day. It is apparent that trial site 9 provides significant 
differences in observer performance, depending on the combination, with 
all other trial sites except 0. Generally, performance at trial site 9 
is better than the other sites, except during the Evening/Morning 
trials. This implies that the physical characteristics of trial site 9 
are, in general, conducive to good performance. Trial site 1 displays 


Significant differences in observer performance with trial site 8 in Day 


~ 
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TABLE 6 


TUKEY-KRAMER METHOD FOR PAIRWISE COMPARISONS: 
COMPARISONS OF FACTOR LEVEL MEAN TIMES TO 
DETECTION FOR TRIAL SITES OVER ALL 
COMBINATIONS OF OBSERVER MOTION AND TIME OF DAY 


Day Overwatch 


Lower Difference Upper 
Trial Site Confidence Between Confidence 
Comparison Buri Means Dimi 
O. -=> -19.81 =1h.16 MPR SS 
07+ 4 =19..96 Tle AA 16904 
C= =6 Site 6 1.2 19.99 
ORS =VOe56 8.48 2Teou 
ieee =64.05 -0.42 6.02 
Ptotae: =p 46 ouet TOON 
ie, 1246 9.64 er slO les 
ie ~4 37 22609 oS 
Be Se FLED 107.05 Wife fee 
oe, a heee9 1.30 16.02** 

Evening/Morning Overwatch 

Lower Difference Upper 
Trial Site Confidence Between Confidence 
Comparison Limit Means Lim: ¢ 
ley 2 =10ee 5) 518 eee 
ieee =| 2564 14.27 11345 
see =62 56 1.94 1054 
eres =TO aT 02418 ei 
(Mts te: =o 0 | 2,42 1.3 300 
laa -4 47 -22.41 49.29 
Ze IIS, =2 1208 ore 38.82 
20rd -20.48 -3.862 12ifoo 
2s oO =O 16.43 
re: mate bs SS =—3, 38 14.77 
eae? Bray el reso 2G 2.14%** 
Se: S50 oi = 2ea 14.90 
Bie “44,942 -14.09 1iGaaran 
35> 6 -40305 =(lieo 5 16288 
See, Si uae =26.100 0.558** 
t= 6 =19526 =e] © 19426 
4 - 8 = trea 0.481 Teas 
4 - 9 =o leo =24535 2.89 
ce, te = Oie 2.24 2 Wee 
6-9 =5 ie +2250 G.26 
ohne, 3605 ~o leo 3.37 
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TABLE 6 (continued) 


Day Moving 

Lower Difference Upper 
Breial Site Confidence Between Confidence 
Comparison Limit Means Limit 
i= OC =O fs ese =O 0 * 
ieee 9 5) ‘Ne pe (sss) 0)! 
ee - 9 =2425 Zao 6.99 

Evening/Morning Overwatch 

Lower Difference Upper 
Trial Site Confidence Between Confidence 
Comparison Lane Means Limit 
im 8 =O > Toe OS =O oO 
n= 9 1 18 = 30 S50 
e- 9 ac rh Corie h 6.99 

Evening/Morning Moving 

Lower Difference Upper 
Trial Site Confidence Between Confidence 
Comparison Li mniist. Means Limite 
i= 6 -0.48 2.41 D..50 
in = 9 Ol (16, creas {.05"* 
ce 9 See, Ono 5) Oks 


* Indicates significance at the 0.05 level for untransformed variables. 
** Indicates significance at the 0.05 level for transformed variables. 
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Trial site 
Comparison 


' 
OW WOW ONO ON FO WOW LF NM 


Trial Site 
Comparison 


1 
1 
ao 


NOR ORE ©) 


* Indicates 


TABLE 6 (continued) 


Night 


Lower 


Confidence 


Limit 


=163 
~33. 
“Dor 
foe 
214 


719 
=i 


Sie 
Sols: 
51S 
3. 
Bao 8) 
=1078 
=o8 
-3, 

4, 
—y. 


soe 
a ff 


38 
20 
38 


DI 


Overwatch 


Difference 


Between 
Means 


moe 
= Ono 
29 Ny 
=0n oo 

Geer 
cafe les 
[25.05 
Sone 
Ome 


Night Moving 


Lower 


Confidence 


mae 


orc 
Se 
ie 


significance at the QO. 


50 
BD 
02 


Difference 


Between 
Means 


“7.71 
[ORO 
ool 


Upper 


Confidence 
amie 


10.68 
27 
mee re) 
6.44 
BIE Oe, 
16.32 
ies 
V2 
2 ON 
Vara 
26.93 
12 od 
49.06 
64.35% 
30200 


Upper 


Confidence 
Lima y 


2 ee 
Bi 2) | 
14.19% 


05 level for untransformed variables. 


** Indicates significance at the 0.05 level for transformed variables. 
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Moving and Night Moving trials, and trial site 6 in Night Overwatch 
trials. In these cases, performance at this site is better than at the 
other sites. The implication is the same as above. 

Table 7 displays the comparisons of the factor level mean times 
to detection for ene type in Day Moving and Night Overwatch trials.The 
results confirm what one might expect. Namely, observers with optical 
Sights perform better in the day time and observers with thermal sights 
perform better at night. The difference in Night Overwatch trials 
appears to be larger in comparison to the Day trials. 

Table 8 shows the comparisons of the factor level mean 
proportion of targets detected for sight types over all observer motion 
and time of day combinations, except Day Overwatch and Night Overwatch 
trials. Note that observers with optical sights perform better than 
observers with thermal sights in the Evening/Morning trials. Evening 
and morning are something of a 'gray' area in terms of light level. The 
other results in Table 8 follow what one would ecneively expect. 

Table 9 displays the comparisons of the factor level mean proportion 
of targets detected for range over all observer motion and time of day 
combinations except Evening/Morning Overwatch and Night Overwatch trials 
(in which case the range factor was not significant). The results are 
fugpeising. Nove that in those cases where Significant differences 
exist, the differences suggest that observer performance is better at 
longer ranges. This is not what one would expect. Generally, one would 


think that performance would be better at shorter ranges. 


— 
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TUKEY-KRAMER METHOD FOR PAIRWISE COMPARTSG TS 
COMPARISONS OF FACTOR LEVEL MEANT TIMES TO UEiE Gwe. 
FOR SIGHT TYPES IN DAY MOVING AND NIGHT OVERWAT CHS tee 


Day Moving 
Lower Difference 
Sight Type Confidence Between 
Comparison Bo Jigaine Means 
Optical<-Thermal “4.65 =27eae 
Night Overwatchn 
Lower Difference 
Seco ype Confidence Between 
Comparison Lim Et Means 
Optical-Thermal 1216 Relelens, 


Upper 
Confidence 
Limniee 


O-0laa* 


Upper 
Confidence 
Lime 


20 as 


* Indicates significance at the 0.05 level for untransformed variables. 
K¥ Tndicates significance at tne 0.05 level for transformed variables. 
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TABLE 8 


TUKEY-KRAMER METHOD FOR PAIRWISE COMPARISONS: 
COMPARISONS OF FACTOR LEVEL MEAN PROPORTION OF TARGETS 
DETECTED FOR SIGHT TYPES IN DAY MOVING, EVENING/MORNING 

OVERWATCH, EVENING/MORNING MOVING AND NIGHT MOVING TRIALS 


Day Moving 
Lower Difference Upper 
Sight Type Confidence Between Confidence 
Comparison jb chia aah Means Limit 
Optical-Thermal 0.03 0.08 Oua2s 


Evening Overwatch 


Lower Difference Upper 
Sight Type Confidence Between Confidence 
Comparison iabjulilis Means Limit 
Optical-Thermal Ore | =Occle -—0.04% 


Evening Moving 


Lower : Difference Upper 
Sight Type Confidence Between Confidence 
Comparison Ermine Means Limit 
Optical-Thermal al0 re =O 05 0.002** 


Night Moving 


Lower Difference Upper 
Sight Type Confidence Between Confidence 
Comparison Limit Means Limit 
Optical-Thermal Cea C220 0.24% 





* Indicates significance at the 0.05 level for untransformed variables. 
** Indicates significance at the 0.05 level for transformed variables. 


TABLE 9 


TUKEY@KRAMER METHOD FOR PAIRWISE COMPARISONS: 
COMPARISONS OF FACTOR LEVEL MEAN PROPOR) IONVOR Stan ee > 
DETECTED FOR RANGE IN DAY OVERWATCH, DAY MOVING, — 
EVENING/MORNING MOVING AND NIGHT MOVING TRIALS 


Day Overwatch 


Lower Difference Upper 
Range Confidence Between Confidence 
Comparison Limit Means Lime: 
Short<=Medium =). 14 =0.04 0.06 
Short —Loens =072:02 0.08 Owe 
Medium=Long 0.02 Onae 0.22* 
Day Moving 
Lower Difference Upper 
Range Confidence Between Confidence 
Comparison Limit Means LImit 
Short=Medium =0n06 0. 0032 O7eg 
Short=Long -0.04 0) 8 0.09 
Medium=Long -0.046 0.02 0.09 © 


Evening Moving 


Lower Difference Upper 

Range Confidence Between Confidence 
Comparison Limit Means Limit 
Short<=Medium 0.62 0.09 OR fe 
Short<Long O27 O15 0.24% 
Medium~Long =9102 0.06 Ome 


Night Moving 


Lower Difference Upper 
Range Confidence Between Confidence 
Comparison bimils Means Li mide 
Short=Medium =0.02 0.03 0.09 
Snort—luong 0.02 0.08 O514% 
Medium=Long =0 70) 0705 Onn 


* Indicates significance at the 0.05 level for untransformed variables. 


Table 10 displays the comparisons of the factor level mean 
proportion of targets detected for trial sites in Day Moving, Evening 
Overwatch and Night Overwatch trials. poser vars at trial site 6 display 
significant differences with observers at trial sites 1, 2 and 4 in 
Evening Overwatch trials and trial sites 8 and 9 in Night Overwatch 
trials. In these cases, performance at this site is better than at the 
other sites. In Night Overwatcen trials, observers at trial site 1 
display significant differences with observers at trial site 9 and 
observers at trial site 2 display differences with observers at trial 
site 8 and 9. In general, performance at trial site 6 is better than 
the other sites in all cases, except sites 8 and 9 in Evening Overwatch 
trials. However, note that the mean proportion of targets detected are 
not significantly different. 


3. Analysis of Mean Times to Detection and Mean Proportion of 
Targets Detected for Interacting Factors 


Since there are 65 comparisons of interest, and only three 
treatments provide significant differences in the mean times to 
detection, only those comparisons resulting in significant differences 
Will be displayed. Table 11 displays the comparisons of the treatment 
Meamiecimes Lo delection for Day Overwatch trials. Note that the 
observers with the thermal sight, closed hatch and long range (TCL) 
treatment display significant differences with all other observer 
treatments except thermal sight, closed hatch, medium range (TCM) and 
thermal sight, open hatch, short range (TOS). Treatment TCM observers 


display significant differences with the observer treatments optical 
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TABLE 10 


TUKEY-KRAMER METHOD FOR PAIRWISE COMPAR or. 
COMPARISONS OF FACTOR LEVEL MEAN PROPORTION OF 
DETECTIONS FOR TRIAL SITE IN DAY MOVING, EVENING 
OVERWATCH AND NIGHT OVERWATCH TRIALS 


Day Moving 

Lower Difference Upper 
Trial Site Confidence Between Confidence 
Comparison Limit Means pal ic 
ts -0.04 On02 0.08 
et, =0°505 0.04 Onc 
ste, =O 70% Ole Oe 0...60 

Evening Overwatch 

Lower Difference Upper 
Trial Site Confidence Between Confidence 
Comparison Limit Means alia Be 
Ress 2 =0.,54 =O7 2) On3 
lees =0540 le On o2 
ee 0) ee =0707 0.09 
Peete Sale O25 Oe 0= 
tears’ =O725 =On02 0.19 
La n9 =O530 0.08 0.54 
oy 15 =Onteo OAS) On| 
o> 4 =O 421 Oe 3 0.48 
aaa 07.07 0.46 0.84% 
iS SOc 0.19 O.S5 
eee =0:326 0.29 0.84 
Ber oe =0)00 =Or 13 0254 
Balan =O 3] O19 OL7e 
Sans =O =19i. Ole: oe 
Sma =o] ORs 0.66 
i=. 6 0206 05335 Os oo] 
ats. =Onale Cale 0.29 
en, =On O16 0.63 
briaLo =0 560 SOY O02 
Sie BS: = 0) Sows =Oieals/. On.33 
§ = 9 =O ae TS) 0.59 
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TABLE 10 (continued) 


Night Overwatch 


Lower Difference Upper 
Trial Site Confidence Between Confidence 
Comparison Limit Means Limit 
ms 2 =O, 00 0.14 0.28 
ie 4 =O 30 SOs OF 28. 
i 6 UES) 0.18 0.40 
ie So =Ogee =l0)A 08s OFOy 
lie= 9 -0.45 =Oece 10) Ole: 
eH =0.45 =9219 O07 
2 16) =0219 0.04 Ose 
2 ae! eOus =) ee 0.005 
ee 9 =O. 59 =), 36 =Ols* 
a 6 =07.09 Ones 0.54 
Ne) =0-29 BOOS Ox 
w= 9 -0.49 0% [ke 0.14 
oe 6 -0.49 =O.2o SOO 2 
se 9 -0.69 -0.40 =O tiles 
ce 9 [0530 =O iS 0.09 


* Indicates significance at the 0.05 level for transformed variables. 


TABLE a 


TUKEY-KRAMER METHOD FOR PAIRWISE SCOM@AR aii. 
COMPARISONS OF TREATMENT MEAT INES 
DETECTION IN DAY QOVERWATCH TRIALS 


Lower Difference Upper 
Treatment Confidence Between Confidence 
Comparison Limit Means Limit 
Tei OCS 10.43 26532 42.22 
1 Cues OCM 8.95 Pass || fi 39.38 
TEES OCL 4.31 20.68 3{ 05 
Tel =200S se (0) 26.54 42.00 
Tebe= 00" 13305 28 . 06 43.06 
ECi-=.60L 1.63 lie 33.42 
TCL TCs 4.18 20 763 37.49 
UGE maps eel 3.16 19235 35254 
TEG== EOL 3.61 19.76 35.92 
TEM A=-0eS iol ional 3 eee 
TCM == OCM Oel9 14.16 28.13 
TEM e=.00S 2.29 lees 302i 
TCM = 00M 4.31 1005 31.78 
TOSe= OOM 1,09 14.15 Cleese 


O - in first position indicates optical sight and in second poesia 
indicates open hatch. 


T= Indicates: thermal signet 
Car indicates open naven. 
L - indicates long range. 
M - indicates medium range. 


SvSsiindl Caves 2onoey srrange. 


sight, elosed haten and optical sight, open hatch at short and medium 
ranges. Treatment TOS observers display Significant differences waa 
the optical sight, open hatch, medium range observers. It is clear Ui 
in Day Overwatch trials, the pemionmaice of thermal sights with havea 


closed at medium and long ranges is consistently poorer than the other 


58 


Sreatments, especially at long range. In general, observers well Gohl 
optical sights perform better in Day trials. 

| The comparisons of the mean times to detection for combinations 
of sight type and range in Evening/Morning trials is shown in Table le. 
Elgiificant Mresrcnces displayed are for observers with thermal sights, 
short range versus observers with thermal sights at medium and long 
ranges. Short range performance is better. Note that for 
Evening/Morning trials, performance is similar. This is intuitively 
pleasing in that during the evening and morning, it is not quite dark 
and not quite light. One would expect performance, in general, to be 
Similar. However, one would expect performance at shorter ranges to be 
better than longer ranges for both sight types. This is not the case. 

Table 13 displays the comparisons of mean times to detection for 
combinations of hatch status and range in Night Overwatch trials. The 
results show as would be expected, that performance for open hatch, 
short range observers is better than closed hatch short range and open 
hatch medium range observers. 

Comparisons of means time to detection for combinations of sight 
type and hatch status in Night Moving trials are shown in Table 14. The 
results Show that the performance of tank observers with optical sights 
and closed hatches is poorer than thermal sight observers with open or 
closed hatches. Note that the observers with optical sights and open 
mavens do not perform Significantly different from observers with 
thermal sights and open or closed hatches. One might think that thermal 
Sights, regardless of hatch status, would perform better fen Ope Lea | 


memcvs if the time of day is night. 


Sy, 


** Indicates significance at 0.05 level for transformed variables, 


TABLE “We 


TUKEY“KRAMER METHOD FOR PAIRWISE COMPARISONS: 


COMPARISONS OF MEAN TIMES TO DETECTION FOR COMBINATIONS 


OF SIGHT TYPE AND RANGE IN EVENING/MORNING TRIALS 


Lower 
Confidence 

Combination Eimaiee 
OS OM =9'.95 
OS =. OL = Se 
OS TS =) (3) | 
OS ™ ONES) i 
OS Be 110) 
OM OL owed 
OM LS =o 
OM T™ =l2eoG 
OM Th -13.73 
OL TS =O .97 
OL T™ = (aoe 
OL Te i050) | 
TS T™ =Ter le 
ES Ts =19..0e 
T™ Hele “12.44 


where, 

Or=s00t iCal Signe. 
T = thermal sight. 
pe==short range. 

M = medium range. 
L = long range. 


one 


Difference 
Between 


Means 


Beth 
Pee, 
Seley 
eA 
1.43 


Upper 


Confidence 
Limit 


15.49 
OS Se 
20876 
14.17 
ieae2 
Oneo 
lens 
Mab SIS 
Ileal 
eneue 
17.42 
iGo 


4 ,58** 
Beas 


10.7 1 


TABLE 13 


TUKEY-KRAMER METHOD FOR PAIRWISE COMPARISONS: 
COMPARISONS OF MEAN TIMES TO DETECTION FOR COMBINATIONS 
OF HATCH STATUS AND RANGE IN NIGHT OVERWATCH TRIALS 


Lower 
Confidence 

Combination Limit 
es —- CM eet U.. 
Gee CL lt a ae 
es - OS -4 56 
co — OM 245) 0 eae 
eo — OL =10,4 3 
ein = CL (5 15 
cM = OS ~9 47 
evr = OM =Se OD 
ey = OL =—1 575.1 
ee —- OS ~11.49 
cee— OM =350 3 
Ge — OL =e 0 
Ss - OM = Sie s) 
ws — OL sche. 3 
eMe— OL =—61 3 


Difference 
Between 


Means 


=e 
ai 
14. 


Upper 


Confidence 
lEphiarakys 


¥*¥ Indicates significance at 0.05 level for transformed variables, 


where, 

we- closed hatcn. 
O = open hatch. 

S = short range. 


M = medium range. 


c~ 
tl 


long range. 
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TABEE SS 


TUKEY*KRAMER METHOD FOR PAIRWISE COMPART SGI 
COMPARISONS OF MEAN TIMES TO DETECTION FOCRe Ge eae reis 
OF SIGHT TYPE AND HATCH STATUS IN NIGHIMG Ge ieee. 


Lower Difference Upper 
Confidence Between Confidence 

Combination Limit Means Ev mae 
OG = 00 “2.609 Sees 18.96 
Ce he S555 Us ey Cte cer 
OC IPG; 4l2y 1354 Bape Ae! 
OO Te =3.01 4.24 hes 2s) 
OO TO os el 5.08 bao 
Le TO = 48 0.84 on ee 


* Indicates significance at 0.05 level, 
where, 


QO = in first position denotes optical sight and in second poSitlonyaage 
haven. 


C = closed hatch. 


T = thermal sight. 


Table 15 displays the mean proportion of detections ia. 
combinations of sight type and range in Night Overwatch trials.Observers 
with thermal sights perform consistently better in comparisons with 
observers with optical sights at the same ranges. In addition, =item 
observers with optical sights at medium and long ranges, all thermal 
observers perform better. The same is true for optical sights at snems 
range, except for observers with thermal sights at long ranges 
Observers with optical sights do noterperlonnaine significantam 
different manner over all ranges. Thermal observers at short ranges 


perform better than thermal observers at long ranges. All resulUS am 


consistent with the author's a priori expectation. 
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CARES 15 


TUKEY-KRAMER METHOD FOR PAIRWISE COMPARISONS: 
COMPARISONS OF MEAN PROPORTION OF DETECTIONS FOR COMBINATIONS 
OF SIGHT TYPE AND RANGE IN NIGHT OVERWATCH TRIALS 


* Indicates significance at 0.05 level, 


where, 


0 


gptical sight. 


It thermal sight. 
5 snort range. 

M medium range. 
L long range. 


63 


Lower Difference Upper 
Confidence Between Confidence 
Combination Dimi. Means Limit 
OS OM =O 0G 0.14 0.33 
OS OL -0.14 0.04 0523 
OS iS . =O) 0) Pe te) -0.16* 
OS TM -~0.43 =O 72 0), (0ie is 
OS TL =O 3 -0.14 0.04 
OM ts =0.67 -0.49 =O" 
OM TM =O) ars “0.39 =0220* 
OM We Oey =(9) 203 =O 09% 
OL LS =O75 =05.39 =Oyenl 
OL TM =54/ P-O0s29 =@ sale 
OL OL =H 30 =0.19 -0.00* 
ies TM -0.08 010 O520 
is TL E03 eeu 0.38% 
TM We =O 0) / 0.11 0.29 


Gs FUNCTIONAL CATEGORY MODELS 
1. General 

The FUNCAT procedure is like ANOVA with qualitative independent 
variables, but with a categorical response variable rather than 
continuous. A response may have two or more levels. The model is 
described by the response and design effects. The design effects group 
the experimental units, factors, into populations. Therefore yee as 
population is a unique combination of the independent variables or 
factors. For example, if sight type and hatch status are the factors in 
the model, there will be four unique combinations, since each factor has 
two levels (e.g. optical sight, hatch closed or hatch open, and thermal 
sight, hatch closed or hatch open). 

Each population has a different multinomial distribution for the 


response counts as shown below [Ref. 4:p. 257]: 


Population Response 1... Response r Sample Size 
1 N14 TGs Nin n, 
: ea Mop ee 
S @! e n n 
S1 sr S 
For each population i, i=1,...,S, the probability of sync ge response 
(Il..)j=1,...r, is estimated by p..=n../n,. These estimates are used to 
D3 iy A 


construct values for a logit function defined on the respomwes 


probabilities. The function may be written as follows: 
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fo = & of oe ne a | 
j n(p, De) j 


Lor eachmpeDUlLacLon i= l,. ..S. 


The function compares every response to the last response, as specified 
feecne User. hice function of the true probabilities. is assumed to 
follow a linear model in terms of the design structure of the samples. 
The same function is applied to each population. The model may be 


written as follows: 
f(H, ) = X.8 + €, [are eee Sy 


where 


and 


where b is the vector of parameter estimates for each effect specified 
in the model. 

The model parameters are best described in terms of the factor 
main effects. If factor A has four levels, then it will have three 
parameters. Each parameter compares the response from the first three 
levels with the fourth. Thus, each parameter corresponds to a design 
column in the design matrix, X. Crossed effects are formed by the 
horizontal direct product of main effects. The degrees of freedom, 


(df), for crossed effects are equal to the product of the df for each 
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separate effect. The design matrix, X, is specified such that each row 
corresponds to a population. A typical design matrix might look like 


the sample below for a model with four populations: 


DATA MAIN-A MAIN-B - CROSSED 


A(1) B( 1) AB(1) 


{ => 





1 1 1 
al | 
al 1 = 
al = 1 


Nh Mm-as— 
NO — Nh — 
hk 


The vector of parameter estimates, b, 1s used to test the fituoer 
the model to the data. Grizzle, Starmer and Koch [Ref. 4] have shown 
that if the hypothesized model fits the data, then b is the best 
asymptotic Normal estimate of the true model parameters. Given a model 
provides an adequate fit to the data, then the parameter estimates are 
used to test hypotheses concerning the model effects. For example, the 
main effects for the factor A equal zero, versus the alternative not all 
A main effects equal zero. 

In order to maintain consistency in the analysis, the FUNCAT 
models that follow were computed for the six separate combinations of 
the factors time of day and observer motion. 

2. Problems Associated with Categorical Responses 

Special problems arise, unfortunately, when the dependent 
variable is categorical [Ref. 7:pp. 322-323]. 

1) Given a response has r levels, the residual terms can only take on 


r values. Clearly, an assumption of Normally distr tps 
residuals is not appropriate. 2 


BA 


2) The residual terms do not have equal variances when the dependent 
variable is categorical. The error variances depend on the 
Daranetvers. 

Even though the residual are not Normal when the dependent 
variable is categorical, the method of least squares still provides 
unbiased estimators of the parameters which, under very general 
conditions, are asymptotically Normal. When the population sample sizes 
are reasonably large, such as is the case of the models that follow, 
inferences concerning the parameter estimates and mean responses are 
made in the same way as when the error terms are assumed to be Normally 
distributed. 

The use of the weighted least squares method is a solution to 
the problem concerning unequal error variances. By employing this 
method, the FUNCAT procedure gives more weight to the population 
response functions with smaller variances. The weighted least squares 
method requires the population sample sizes to be reasonably large. 

In general, if the population sample sizes are reasonably large 
(greater than thirty observations) then the problems associated with the 
model do not preclude using the model. In almost all cases, the 
population sample sizes for the procedures that follow meet the sample 
size requirement. 

3. FUNCAT Procedure for Target Detection as Response Variable 

The response variable, Target Detection has two levels. A valid 
detection is considered to be an initial detection of one of the ten 
targets purposely put in the observer field of view during a trial. 


— 


Hence, a non-valid engagement corresponds to subsequent detection of 


67 


targets or detection of unknown or false targets. Valid detections are 
considered as response category 1 and non-valid detections are response 
category 2. In terms of the model parameters, the last level of the 
factor, hatch status, is open, and the last level of the factor, crew 
member detecting, is the tank commander. Therefore, the hatch status 
parameter is a comparison of closed versus open and the crew member 
detecting parameter is a comparison of the gunner versus the tank 
commander. 

The factors crew member (gunner or tank commander) detecting and 
hatch status were analyzed for each time of day and observer motion 
combination. FUNCAT summaries are shown in Tables 16 through 21. As 
one views the tables, the presence of similarities is evident. In all - 
eases, the differences in the response probabilities across populations 
are not significant for hatch status or crew-member-detecting x hatch 
status interaction effects. The crew member detecting main effects were 
Significantly different in overwatch trials, but not in moving Uriaiiee 
This implies that during moving trials, the probability Of “ay 2uegme 
detection is not significantly different, among the populagiawe 
examined, for the tank commander or gunner. The opposite is true in 
overwaten trials. In all cases, the gunner probability of valid 
detection is higher. This is seen by viewing the response probabilities 
for each population. It should be noted, that in terms of the primary 
design variables, the responses in the model have been aggregated over 


the factors sight type and range. Even with this variability not being 


-~ 


accounted for in the model, the significance of the crew member 


TABLE 16 


FUNCAT SUMMARIES FOR 
TARGET DETECTION AS RESPONSE: DAY OVERWATCH 


PUNCAT PROCEDURE 


RESPONSE: DETECTION RESPONSE LEVELS (R)= Zz 
POPULATIONS ts) — 4 
TOTAL COUNT (N)= 2268 
OBSERVATIONS (OBS)= 2268 
ONE-WAY FREQUENCIES 

VARIABLE VALUE COUNT 

PREACr 1 1436 

2 832 

CREWMBR 1 iy 

Z 996 

HS CLOSED 1053 

OPEN aS 

RESPONSE 
DESIGN PROBABILITIES TOA 
SAMPLE CREWMBR HS i) 2 

i) 1 CLOSED Oa7e4s One s57 628.0 
2 1 OPEN ©87640 0.2360 644.0 
3 2 CLOSED 0.4447 0.5553 425.0 
4 2 OPEN 0.4816 0.5184 Bea. O 
SOURCE DF CHI-SQUARE PROB 
INTERCEPT i 124.29 @olere 
CREWMBR i, 206.09 O,0C01 
HS | il 0.63 0.4268 
CREWMBR*HS 1 0.67 0.4144 
RESIDUAL O 0.00 I AOCOO@ 


CREWMBR = CREW MEMBER DETECTING; 
HS = OBSERVING TANK HATCH STATUS; 


DETECT = DETECTION OF VALID OR NONVALID TARGET. 
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TABLE 17 


FUNCAT SUMMARIES FOR 
TARGET DETECTION AS RESPONSE: DAYSiey iis 


FUNCAT FPROCEEURE 


RESPONSE: DETECT RESPONSE LEVELS (R)= 2 
POPULATIONS (sj= 4 
OBSERVATIONS (OBS)= 856 
ONE-WAY FREQUENCIES 
VARIABLE VALUE COUNT 
DETECT it 390 
y, 466 
CREWMBR 1 499 
2 357 
HS CLOSED 421 
OPEN 435 
RESPONSE 
DESIGN PROBABILITIES TOTAE 
SAMPLE CREWMBR HS | il 2 
1 1 CLOSED 0.4351 0.5649 239.0 
2 1 OPEN 0.4462 0.5538 260.0 
3 2 CLOSED 0.5055 0.4945 182.0 
4 2 OPEN 0.4457 0.5543 175.0 
SOURCE DF CHI-SQUARE PROB 
INTERCEPT 1 5.83 0.0157 
CREWMBR 1 1-62 0.316 
HS 1 0.49 0.4835 
CREWMBR*HS 1 a Oe! 0.3072 
RESIDUAL O 0, 00 1.0000 


CREWMBR = CREW MEMBER DETECTING; 
HS = OBSERVING TANK HATCH sSiarus 


DETECT = DETECTION OF VALID OR NONVALID  TARGEie 


TABLE 18 


FUNCAT SUMMARIES FOR 
TARGET DETECTION AS RESPONSE: EVENING/MORNING OVERWATCH 


FUNCAT PROCEDURE 


BeoPONSE: DETECTION RESPONSE LEVELS 


ck) = 2 
POPULATIONS (Sq 4 
Towa COUNT (N)= 1650 
OBSERVATIONS (OBS)= 1650 
ONE-WAY FREQUENCIES 

VARIABLE VALUE COUNT 

DETECT iL LiL Ge 

2 aS, 

CREWMBR 1 935 

2 715 

HS CLOSED 840 

OPEN 810 

RESPONSE 
DESIGN PROBABILITIES TOTAL 
SAMPLE CREWMBR HS il 2 

1 1 CLOSED Om7s23 0.2077 491.0 
2 1 OPEN 0.8108 0.1892 444.0 
3 2 CLOSED 0.5845 0.4155 349.0 
4 2 OPEN — 0.6011 0.3989 366.0 
SOURCE DF CHI-SQUARE PROB 
INTERCEPT 1 250.13 0.0001 
CREWMBR 1 83.02 0.0001 
HS 1 0.68 0.4084 
CREWMBR*HS il 0.05 0.8303 
RESIDUAL O -0.00 1.0000 


CREWMBR = CREW MEMBER DETECTING; 
HS = OBSERVING TANK HATCH STATUS; 


DETECT = DETECTION OF VALID OR NONVALID TARGET. 
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TABLE 19 


FUNCAT SUMMARIES ies 
TARGET DETECTION AS RESPONSE: EVENING/MORNING MOVING 


FUNCAT PROCEDURE 


RESPONSE: DETECTION RESPONSE LEVELS (R)= 2 
POPULATIONS (sj= 4 
TOTAL COulm (N)= See 
OBSERVATIONS (OBS)= 822 
ONE-WAY FREQUENCIES 
VARIABLE VALUE COUNT 
DETECT il 382 
2 440 
CREWMBR 1 499 
2 323 
HS CLOSED 431 
OPEN 391 
RESPONSE 
DESIGN PROBABILITIES TOTAL 
SAMPLE CREWMBR HS 1 2 
1 1 CLOSED 0.4436 0.5564 27556 
2 1 OPEN 0.4554 0.5446 22406 
3 2 CLOSED 0.5192 0.4808 156.0 
4 2 OPEN 0.4611 0.5389 167.0 
SOURCE DF CHI-SQUARE PROB 
INTERCEPT i 2.85 0. Osim 
CREWMBR 1 ee 0.2558 
HS il 0.42 0.5182 
CREWMBR*HS 1 0.95 0.32om 
RESIDUAL O opmele 1.0000 


CREWMBR = CREW MEMBER BETECITic- 
HS = OBSERVING TANK HATCH STATUS; 


DETECT = DETECTION OF VALID OR NONVALID TARGET: 


TABLE 20 


FUNCAT SUMMARIES FOR 
TARGET DETECTION AS RESPONSE: NIGHT OVERWATCH 


FUNCAT PROCEDURE 


RESPONSE: DETECTION RESPONSE LEVELS (R)= 2 
POPULATIONS S)\ = 4 
TOUAL COUNT (N= 1260 
OBSERVATIONS (OBS)= 1260 
ONE-WAY FREQUENCIES 
VARIABLE VALUE COUNT 
DETECT il 803 
2 457 
CREWMBR 1 704 
2 556 
HS CLOSED 633 
OPEN 627 
RESPONSE 
DESIGN PROBABILITIES TOTAL 
SAMPLE CREWMBR HS i 2 
1 CLOSED 0.6984 0.3016 368.0 
2 1 OPEN 0.6250 0.3750 336.0 
3 2 CLOSED 0.6000 0.4000 265.0 
4 2 OPEN 0.6082 0.3918 291.0 
SOURCE DE CHI-SQUARE PROB 
INTERCEPT 1 86.49 0.0001 
CREWMBR i 4.57 0.0325 
HS 1 1.55 0.2107 
CREWMBR*HS i DOG 0.1240 
RESIDUAL O 0800 1.0000 


CREWMBR = CREW MEMBER DETECTING; 
HS = OBSERVING TANK HATCH STATUS; 


DETECT = DETECTION OF VALID OR NONVALID TARGET. 


TABLE 21 


FUNCAT SUDMART ES eEOR 
TARGET DETECTION AS RESPONSE: NIGH ee 


FUNCAT PROCEDURE 


RESPONSE: DETECT RESPONSE LEVELS (R)= 2 
POPULATIONS (Se 4 
TOTAL COUNT (N)= 693 
OBSERVATIONS (OBS)= 693 
ONE-WAY FREQUENCIES 
VARIABLE VALUE COUNT 
DETECT 1 319 
2 274 
CREWMBR 1 437 
2 256 
HS CLOSED 365 
OPEN 328 
RESPONSE 
DESIGN PROBABILITIES TOTAM 
SAMPLE CREWMBR HS 1 2 
1 iMenOcED 0.4635 0.5365 2330 
2 1 OPEN 0.4363 0.5637 204.0 
3 ZaelOscnD 0.4470 0.5530 13250 
4 2 OPEN ' 0.5081 0.4919 12456 
SOURCE DF CHI-SQUARE PROB 
INTERCEPT 1 3.40 0.0653 
CREWMBR i 0.49 0.4833 
HS 1 0.18 0.6694 
CREWMBR*HS 1 1.26 0.2615 
RESIDUAL O 0.00 1.0000 


CREWMBR = CREW MEMBER DETECTING; 
HS = OBSERVING TANK HATCH STATUS; 


DETECT = DETECTION OF VALID OR NONVALIE 7. ¢: 
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differences in the response across populations speaks CO UMnessurengtun of 
the difference. 
4, FUNCAT Procedure for Crew Member Detecting as Response Variable 

The response variable, Crew Member Detecting has two levels. 
Detection of targets, valid or non-valid, by the gunner are considered 
as response category 1 and detections by the tank commander as response 
category e. 

The factor target attributes is analyzed for each time of day 
and observer motion combination. Each target detected, including 
unknowns and false targets, has several attributes which are associated 
fepeneelo during a trial. Table 22 provides a description of the 
attributes associated with a target during a trial. Since there is only 
one factor studied, the ten levels of the factor target attributes are 
the populations considered in the analysis. In terms of the ee 
parameters, the last level of the ae target attributes is the 
baseline target. AS seen in the table, a baseline target has no 
attributes. Therefore, each parameter is a comparison of one of the 
first nine levels with the baseline target. 

FUNCAT summaries are shown in Tables 23 through 28. Significant 
differences in the response probabilities across populations were seen 
in Day Overwatch and Evening/Morning Overwatch trials. It is of 
interest to determine, for these trials, which target attribute 
populations are significantly different in terms of the response. 
Target attribute comparisons are shown in Tables 29 and 30 for Day 


Overwatch and Evening/Morning Overwatch trials, respectively. For both 


Wes 


Population 


Target 
Target 
Target 
Target 
Target 
Target 
Target 
Target 
Target 
Target 


NA above applies to hulks and decoys. 


—$ OMOANNMN FCW hh — 


TARGET POPULATION ATTRIBUTES: 


TABLE 22 


A DESCRIPTION OF TARGET ATTRIBUTES 


Camouflage 


None 
None 
None 
None 
Partial 
Parva 
NA 
Unknown 
Pudi 
None 


Eire ms 


No 

Yes 

No 

No 

No 

Yes 

NA 
Unknown 
No 

No 


APPLICABLE DURING A TRIAL 


Engines 


No 

No 

Yes 

No 

No 

No 

NA 
Unknown 
No 

No 
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Motion 


No 

No 

No 

Yes 

No 

No 

NA 
Unknown 
No 

No 


Crew 
Exposure 


Exposed 

Not Exposed 
Not Exposed 
Not Exposed 
Not Exposed 
Not Exposed 
NA 

Unknown 

Not Exposed 
Not Exposed 


CREW MEMBER DETECTING AS RESPONSE: 


RESPONSE: CREWMBR 


SAMPLE 


i 


OWON A UN BWNE 


SOURCE 


INTERCEPT 
TARGET 
RESIDUAL 


CREWMBR = 
TARGET = 


TABLE 23 


FOUNCAT SUMMARIES FOR 


FUNCAT PROCEDURE 


RESPONSE LEVELS 


POLULALIONS 
TOTAL COUNT 
OBSERVATIONS 


ONE-WAY FREQUENCIES 
VARIABLE VALUE 


CREWMBR 


PARC E 


DESIGN 


LARGE 


— 


ale 


OW ON AW BWN EH 


COUNT 
Jt ZZ 
Z els: 
It To 6 
Z 142 
S 156 
- Jy, Os, 
5 60 
6 Jkt 
fl 663 
8 ores 
2 SZ 
10 ZOZ 
RESPONSE 
PROBABIEITIES 
dt 2 
Or6O07070 33910 
0.5634 0.4366 
OR OSS5000.3462 
Oy olbiemOrocs/ 
Ono low O75 S33 
0.4545 0.5455 
0.6546 0.3454 
O235217 00-6479 
0.6452 0.3548 
GO 60620 0239711 
DE CHI-SQUARE 
i 15.44 
a Zoos 
6) 6). O18, 


crew member detecting; 
populations of the factor target attributes. 


a 


OOOO0O0000 0 


HOO 


DAY OVERWATCH 


PROB 
OO0O01 
0001 
0000 


RESPONSE Sw CREVIER 


SAMPLE 


4 


OUWUON AN BWNEH 


SOURCE 


PN ERC re 
ae eae 
RESIDUAL 


CREWMBR = 
TARGET = 


TABLE 24 


FUNCAT SUMMARIES FOR 
CREW MEMBER DETECTING AS RESP@ChSE 


FUNCAT PROCEDURE 


RESPONSE LEVELS 
POPULATIONS 
TOTAL COUNT 
OBSERVATIONS 
ONE-WAY FREQUENCIES 
VARIABLE VALUE COUNT 
CREWMBR 1 499 
2 357 
TARGEM 1 35 
2 39 
3 45 
4. 69 
5 i 
6 3 
7 195 
g 371 
9 De 
10. 65 
RESPONSE 
DESIGN PROBABILITIES 
TARGET 1 2 
i 0.5429 0.4571 
2 0.5641 0.4359 
3 0.6444 0.3556 
4. O. 5207 0-473 
5 0.3636 0.6364 
6 0.6667 0.3333 
7 0.5846 0.4154 
g 0.5822 0.4178 
9 0.5217 0.4783 
10 0.69238 058077 
DF CHI-SQUARE 
1 3.12 
9 7.66 
O =Cnee 


crew member detecting; 
populations of the factor target attributes. 
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DAY MOVING 


Waa eo 


NAN DW 
Hou ue il 


TOT AS 


W 
©'O,@10 42. © © @ oO © 


Ke OO 


Oo 
Cit 
HOON 


PROB 
.O7 7s 
2632 
. 006E 


TABLE 25 


PUNGAT SUMMARIES FOR 
CREW MEMBER DETECTING AS RESPONSE: EVENING/MORNING OVERWATCH 


FUNCAT PROCEDURE 


RESPONSE: CREWMBR RESPONSE LEVELS (R)= VA 
POPULATIONS (S)= 108, 
TOTAL COUNT (N)= 1650 
OBSERVATIONS (OBS)= 1650 
ONE-WAY FREQUENCIES 
VARIABLE VALUE COUNT 
CREWMBR il 935 
Z 7X5 
TARGET at 25 
Z 97 
S deal 
4 194 
5 45 
6 WA 
7 Siz 
8 324 
9 a4 
INE, 186 
RESPONSE 
DESIGN PROBABILITIES TOTAL 
SAMPLE TARGET 1 Z 
if iL 0.6480 0.3520 WS. 10) 
2 2 0.5258 0.4742 Sv ar ©) 
3 S OFemlzZe 0.3874 Pie 
= + O25s6el 0.4639 194.0 
5 5 0.6444 0.3556 45.0 
6 6 O27 500050. 5000 ALA G. 
7 7 OF 6719 70.3231 Pilz OC 
8 8 Oss 9570 6605 324.0 
9 g G2 5000 0.5000 44.0 
10 10 0.6452 0.3548 seis a6, 
SOURCE DFE CHI-SQUARE PROB 
INTERCEPT al 92335 0) 4 (OAS: 
TARGET "9 98.45 020001 
RESIDUAL O- -0.00 1.0000 
CREWMBR = crew member detecting; 
manok l — populations of the factor target attributes. 
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TABLE 26 


FUNCAT SUPMMARTES Shek 
CREW MEMBER DETECTING AS RESPONSE: 


EVENING/MORNING MOVING 


FUNCAT PROCEDURE 


RESPONSE: CREWMBR RESPONSE LEVELS (R)= Z 
POPULATIONS (S)= 10 
TOTAL COUNT (N)= 822 
OBSERVATIONS (OBS)= SzZzZ 
ONE-WAY FREQUENCIES 
VARIABLE VALUE Counr 
CREWMBR ik 499 
Z 323 
TARGET al 34 
Z 42 
3 Syal 
“r 68 
5 Jeg 
6 2 
7 ew 
8 359 
9g * 
10 UES 
RESP ORS ® 
DESIGN PROEAB TOIT Is TOTAE 
SAMPLE TARGET 1 Z 
a il Os6076 O235724 34.0 
2 2 0.5476 0.4524 42.0 
3 3 026275 0239 2> le 1 
-+ 4 O.S58Se0- 4412 sper. ©, 
> 5 0.590970 4071 Z28© 
6 6 1 20000 070000 20 
i) 7 O. 5963 024037 LGA © 
8 8 0.6240 0.3760 Byers! 10 
9 9g 0.300070, 500¢ 4.0 
10 © O. 6076 0-3 924 792 
SOURCE DE CHI-SQUARE PROE 
INDERCE EL aro: 4.92 O. 026s 
TARGET 9 2.47 0.9818 
RESIDUAL 0 87018, 1.C0o6 
CREWMBR = crew member detecting; 
TARGET = populations of the factor target attributes. 
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TABLE 27 


FUNCAT SUMMARIES FOR 
CREW MEMBER DETECTING AS RESPONSE: NIGHT OVERWATCH 


a FUNCAT PROCEDURE 
REOFONSE: CREWMBER RESPONSE LEVELS (R)= Z 
POPULATIONS (S)= 10 
TOTAL COUNT (N)= 1260 
OBSERVATIONS (OBS)= 1260 
ONE-WAY FREQUENCIES 
VARIABLE VALUE COUNT 
CREWMBR 1 704 
Zz 556 
TARGET al 96 
Z 74 
3 90 
+ 154 
5 34 
6 eZ 
i) Zoo 
8 369 
9 19 
Me, 144 
RESPONSE 
DESIGN PROBABILITIES TOTAL 
SAMPLE TARGET 1 2 
1 J O75625 0.4375 96.0 
Zz Zi 0.5405 0.4595 74.0 
5 3 Om555550.4667 90.0 
4 4 OZo059 ©2396) T5420 
5 5 0.5882 0.4118 34.0 
6 6 Omere 78025833 ee 
7 7 0.5485 0.4515 268.0 
8 8 O22 0-466 3697-0 
9 9 O26316 0.3684 0 
10 10 Oriol O73se9 144.0 
SOURCE DE CHI-SQUARE PROB 
PNEERCEE T al 5.84 O-C157 
TARGET 9 Deo OF 670 
RESIDUAL O | -0.00 1.0000 
CREWMBR = crew member detecting; 
TARGET = populations of the factor target attributes. 


RESPONSE: CREWMBR 


SAMPLE 


OW ONAN PWNEH 


SOURCE 


INTER SEEPS 
TARGET 
RESIDUAL 


CREWMBR = 
TARGET = 


TABLE 28 


FUNCAT SUMMARIES FOR 
CREW MEMBER DETECTING AS RESPONSE: NIGHT MOVING 


FUNCAT PROCEDURE 


VARIABLE VALUE 


CREWMBR 


TARGET 


DESIGN 


TARGHEE 


je 


RESPONSE LEVELS 
POPULATIONS 
TOTAL COUNE 
OBSERVATIONS 
ONE-WAY FREQUENCIES 
COUNT 
al 437 
Z Zoo 
ut ope, 
2 a0 
S SS 
4 a3 
=, 14 
6 S 
fi Tis 
8 Za 
2 10 
19 74 
RESPONSE 
PROBES ELVES 
1 2 
O./09Z7022362 
0.5333) 024250607 
0; 8000) 022000 
OM elO SiS RO = Sisiz 
0.5714 0.4286 .- 
O{6667 © Gheese 
Ossie 16). allt: 
0 6826 30rsoiZ 
0.4000 0.6000 
0.6216 (Ore7 sa 
DE CHI -SOUARE 
1 9222 
2 12209 
0 -O.00 


OW ON AM PWNEF 


crew member detecting; 
populations of the factor target attributes. 


(R) 
(S) 
(N) 
OBS) 


BRO ABUL, 


SOG @ OO Oro © © 


MH OO 


O° 
0 
WON 


69s: 


PROE 


. 0022 
2 
. 0000 


TABLE 29 


TARGET ATTRIBUTE COMPARISONS 


FOR DAY OVERWATCH TRIALS 


CONTRAST 
TARGET1=-TARGET2 
TARGET1=-TARGETS3 
TARGET1-TARGET4 
TARGET1-TARGETS5 
ton eGe ll =TARCETS 
TARGET1~TARGET?7 
TARGET1-TARGETS8 
TARGET1=-TARGET9Y 
TARGET1=TARGET10 
LARGETZ-TARGET3 
TARGET2-TARGET4 
TARGET2=-TARGETS 
TARGETZ=-TARGET6 
TARGET2-TARGET7 
TARGET2Z-TARGETS 
TARGET2=-TARGETS 
TARGET2 -TARGET10 
TARGET3 ~ TARGET4 
TARGET3 -TARGETS 
TARGET3 - TARGET6 
TARGETS - TARGET?7 
TARGET3 =~ TARGETS 
TARGET3-TARGET9Y 
TARGE LS -TARGETIO 
TARGET4-TARGETS5 
TARGET4-TARGET6 
TARGET4=-TARGET7 
TARGET4-TARGET8 
TARGET 4-TARGETS 
TARGET4-TARGET10 
TARGETS =-TARGET6 
TARGETS ~ TARGET? 
TARGETS -TARGETS 
TARGET5S=-TARGET9Y 
TARGET5=-TARGET10O 
TARGET6=-TARGET 7 
TARGET6-TARGETS 
TARGET6-TARGETS 
ieRGE £o-TARCETIO 
TARGET /~TARGETS 
TARGET 7=-TARGETY 
TARGET7=-TARGET10 
TARGET8-TARGETS 
oom o= LARGE TO 
TARGETY=-TARGET1O 


PRP PPP PPP PPP PPP PPP PPP PPP PPP P PPP PP PP PPP PP PPPPH PH 


DE CHI-SQUARE 


WwW 


NO 


fs 


As 


is 


j— 
O 
HOMOWDWONODOKFOKFPOOMNUODOONFPRPOWONORFPODOOKRFPOROODOONODORKFOOO00 


O’ FH 


OOOCOOOCOSOOODOOOOO DOOD OOO OOOO OOO OCC e 6e eo Se lererelorere 


PROB 
.4248 
.4116 
.9620 
.9173 
.3189 
,2841 
.0001 
.6198 
.4440 
mos 
3480 
.4837 
.4868 
.0407 
,0001 
,2759 
.7257 
3838 
.6095 
.1929 
.9858 
,0001 
.9034 
.0598 
.9388 
.3044 
.2144 
,0001 
Seaiky 
.3189 
.3198 
5552 
.0001 
7444 
S20 
.1787 
.4848 
.2380 
3637 
.0001 
.8813 
.0028 
.0001 
.0001 
.2590 


TARGET ATIRIBUTE COMPARIS Ors 


TABLE 30 


FOR EVENING/MORNING OVERWATCH TRIALS 


CONTRAST 
TARGET1-TARGETZ2 
TARGET -TARGE As 
TARGET1-TARGET4 
PARGHET l-TAkeeils 
TARGET1=-TARGET6 
TARGET 1=TARGET7 
TARGET1=-TARGETS8 
TARGET1=-TARGET9 
TARGET1=TARGET10O 
TARGET2Z=-TARGETS3 
TARGET2=-TARGET4 
TARGET Z-TARCETS 
TARGET2 -TARGET6 
TARGET2 - TARGET 7 
TARGETZ=TARGETS 
TARGET2 - TARGETS 
TARGET2=-TARGET10 
TARGET3 -TARGET4 
TARGET3 =-TARGETS 
TARGET3=-TARGET6 
TARGETS =TARCGET] 
TARGET3 - TARGETS 
TARGET3-TARGET9 
TARGETS =TARGETIO 
TARGET 4=-TARGETS 
TARGET4=-TARGET6 
TARGET 4=-TARGET7 
TARGET 4=-TARGETS 
TARGET4=-TARGETSY 
TARGET4=-TARGET10 
TARGET5-TARGET6 
TARGETS - TARGET 7 
TARGETS -TARGETS 
TARGETS -TARGET9Y 
TARGETS —~TARGE Io 
TARGET6-TARGET/ 
TARGET6-TARGETS8 
TARGET6-TARGETS 
TARGET6-TARGET10O 
TeRGEl/-lAkeaie 
TARGET 7/7 -TARGETSY 
TARGET7 -TARGET10 
TARGET8-TARGETY 
TARGET8=-TARGET10 
TARGET9-TARGET10 


BPH PPP PPP PPP PPP PPP PPP PPP PPP PPP PPP PPP PPP PPP 


©O 
al bag 


CHI-SQUARE 


GW 


ke 


HH No 


fH 


— © 


H> ° 
ON PUOBPOOKRPKFPKHRFRRPODOOWOKRFORRRFBRRFOOQOKROOON ORF ORWNWOrF OW DO W 


Meee eG OOOO OCOOOOOCOOOOCOOOCOOCOOOCoO COC eo eo eee. 


PROB 
 Ostic 
Jo / Se 
.0487 
NESS 
-d1L47 
. Ole; 
_ O@@T 
Uses 
. 0586 
- 2078 
BishershO 
. LSes 
. Soc 
O0SzZ 
. OOM 
-/7 6s 
.4454 
Rass) 3) 
. 7104 
-4520 
Lone 
- OOOH 
BAC: 
2 oe 
S183 
. 8080 
-0003 
.O001 
Pisilsja 2 
. 4683 
= SSIS 
Ova, 
0002 
miley ene 
. 2443 
22035 
_ 2500 
.0000 
.6246 
.OO0O01 
0233 
-OOCH 
mO)S <7) 
~OOOR: 
.3647 


types of trials, the target attribute population described as unknown 
provides significant differences in the response when compared with all 
other target attribute populations, except targets firing from partial 
concealment. This is a very interesting result. By viewing the 
response probabilities for the unknown population, one can see that the 
tank commander is more likely to detect an unknown target. This result 
Suggests that the false target rate for the tank commander is higher 
than the gunner's false target rate. In thiS particular data set, the 
tank commander is about twice as likely to detect an unknown or false 
target is compared to the gunner. In Evening/Morning trials, there are 
also significant differences in the response for hulks as compared to 
targets in full concealment and target motion with engines remaining 
onafter movement. By viewing the response probabilities, one can see 
that the gunner is more likely to detect hulks as compared to the tank 


commander. 
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IV. SUMMARY, CONCLUSIONS AND RECOMMENDATIONS 


A. SUMMARY 
1 eee Oe ken 

To determine the effects of several specific factors on the 

target acquisition process for tanks. 
2. Wbiscussion 

In order to acquire information related to the problem of target 
acquisition, a field experiment was designed and conducted by members of 
the United States Army Combat Developments Experimentation Center (CDEC) 
at Fort Hunter Ligget, California, during the period, 19 July throvgiaa 
December 1983. Tank crews, consisting of a tank commander and gunner, 
were placed in tanks and presented with various target arrays (e.g. 4 
Sere 2 decoys). These observers were in both moving (attacking) and 
overwatch (defending) roles. The tank crews were required to locate, as 
accurately as possible, the positions of the target vehicles and to 
engage those vehicles which posed a threat to the observers. 

Controlled factors such as time of day, observer-target range; 
observer sight type, observer hateh status and observer motion were 
incorporated into the test, so that the impact of such factors on the 
target acquisition process could be investigated. Target cues, such as 
motion, concealment level, firing status, crew exposure and engine 


Status, as well as, environmental factors such as sky/background visual 
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contrast, target/background temperature contrast, and target/background 
visual constrast were also incorporated into the test. 

The data were analyzed to determine the time required to locate 
targets (times to detection) and number of targets located (proportion 
of targets detected) by various populations of observers specified by 
the controlled observer factors (e.g. observer during daylight hours, at 
short range, with thermal sighting system). Both nonparametric and 
parametric methods rene sed eine themanalytreal process, to test 
hypotheses concerning the effects of the various factors on the observer 


groups. 


B. CONCLUSIONS 
1. Effect of Time of Day 
The factor time of day has significant effect on the mean times 
to detection and mean proportions of targets detected for the observer 
groups studied. Because of its pervasive influence, it was necessary to 
conduct the analyses for remaining factors of interest at each level of 
this factor. 
e. Effect of Observer Motion 
The motion of the observing tank has significant effect on its 
mean times to detection and mean proportions of targets detected. 
Because of its pervasive influence, it was necessary to conduct the 
analyses for remaining factors of interest at each level of this factor. 
3. Effect of Observer Sight Type 
The sight type of the observing tank has Significant effect on 
its mean times to detection and mean proportion of targets detected. 
For the analyses conducted, optical sights perform better in the day and 


on 


thermal sight performance is better at night. Performance mgua 
evening and morning trials does not appear significantly different with 
eltnher Sight. type. 

4. Effect of Observer Hatch Status 

The hateh status of the observing tank has no significant effect 
on the mean times to detection or mean proportion of targets detected. 

5. Effect of Range 

The observer-target range has no significant effect on the mean 
times to detection. 

The observer-target range does have a significant effect on the 
mean proportion of targets detected. The significance runs counter to 
what one might expect. Performance appears to be better at longer 
ranges than at shorter ranges. 

6. Effect of Target Cues 

Target cues do not appear to have significant effect on the mean 
times to Reteocicn or mean proportion of targets detected. For example, 
given a target cue, such as target motion, there are no significant 
differences in the mean times to detection for a moving Or SUtavtiomag 
target. 

7. Effect of Environment 

The physical environment in which targets are presented does 
appear to have a significant effect on mean times to detection and mean 
proportion of targets detected. The data indicates that trial sites 8 
and 9 were conducive to good performance in terms of mean times to 


detection and trial site 6 was good for mean proportion of detections. 


8. Effect of Crew Member Detecting 
The crew member making a detection does significantly effect the 
detection of a valid (target placed in the observer's field of view), or 
non-valid (false targets or subsequent detection of targets) target in 
Day Overwatch and Evening/Morning Overwatch trials. The gunner of the 
observing tank is more likely to have a valid detection as compared to 
the tank commander. In addition, the tank commander is about twice as 


likely to detect false or unknown targets as compared to the gunner. 


C. RECOMMENDATION 
Additional investigation should be made into the physical 
environment in which targets are presented. Review of the closed 


circuit television tapes would be a good first step in this process. 
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